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Abstract 

This paper studies the last-column-block-augmented northwest-corner truncation (LC- 
block-augmented truncation, for short) of discrete-time block-monotone Markov chains 
under subgeometric drift conditions. The main result of this paper is to present an up¬ 
per bound for the total variation distance between the stationary probability vectors of 
a block-monotone Markov chain and its LC-block-augmented truncation. The main re¬ 
sult is extended to Markov chains that themselves may not be block monotone but are 
block-wise dominated by block-monotone Markov chains satisfying modified drift con¬ 
ditions. Finally, as an application of the obtained results, the GI/G/l-type Markov chain 
is considered. 
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1 Introduction 

This paper considers the truncation approximation of discrete-time block-structured Markov 
chains characterized by an infinite number of block matrices. The typical examples of such 
Markov chains are M/G/1-, GI/M/1- and GI/G/l-type Markov chains and level-dependent quasi- 
birth-and-death processes (LD-QBDs) (see, e.g., |[6j] and the references therein) and they appear 
as the queue length processes of various semi-Markovian queues (see, e.g., |[23lD . 

It is a challenging problem to obtain the stationary probability vectors of block-structured 
Markov chains characterized by an infinite number of block matrices. To solve this problem, 
we often use the augmented northwest-comer truncation (augmented truncation, for short). 
More specifically, we form a finite stochastic matrix by augmenting, in some way, the (finite) 
northwest-comer truncation of the transition probability matrix and then adopt the stationary 
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probability vector of the resulting finite stochastic matrix as an approximation to that of the 
original Markov chain. 

Although there are infinitely many variations of such augmented truncation, this paper fo¬ 
cuses on the last-column-block-augmented northwest-comer truncation (LC-block-augmented 
truncation, for short) because it is proved that the LC-block-augmentation is the best (in a 
certain sense) among all the block augmentations if they are applied to the northwest-corner 
truncations of block-monotone transition probability matrices (see [fO] Theorem 3.6] and |20! , 
Theorem 4.1]). Note that block monotonicity is an extension of (classical) monotonicity to 
block-structured Markov chains iflOl Definition 2.5]. 

The main purpose of this paper is to estimate the error of the stationary probability vector ob¬ 
tained by the LC-block-augmented truncation. There are some related studies on the truncation 
of Markov chains. Tweedie lf24il presented a total-variation-distance error bound for the station¬ 
ary probability vector of the last-column-augmented northwest-corner truncation of a monotone 
and geometrically ergodic Markov chain in discrete time. More precisely, Tweedie lf24lT s bound 
is an upper bound for the total variation distance between the stationary probability vectors of 
the original Markov chain and its last-column-augmented northwest-comer truncation. Hart and 
Tweedie O and Liu [fl3ll discussed the convergence of the stationary probability vectors of the 
augmented truncations of continuous-time Markov chains with monotonicity and/or exponen¬ 
tial ergodicity. Masuyama [18, 20] extended Tweedie 11241 ’s result to block-monotone Markov 
chains in discrete and continuous time. 

Without the monotonicity of Markov chains, Herve and Ledoux 0 derived a total-variation- 
distance error bound for the stationary probability vector of the last-column-augmented northwest- 
corner truncation of a geometrically ergodic Markov chain in discrete time. Zeifman et al. If271 
considered a periodic and exponentially weakly ergodic non-time-homogeneous birth-and-death 
process in continuous time, and they presented a total-variation-distance error bound for the pe¬ 
riodic stationary distribution obtained by the truncation of the state space (see also | 2~5 , 261). 

Basically, all the existing results mentioned above assume geometric ergodicity (exponen¬ 
tial ergodicity in continuous time) and thus they are not applicable to Markov chains with 
subgeometric ergodicity (including polynomial ergodicity). For example, reflected Markov 
additive processes and GI/G/1 -type Markov chains with the heavy-tailed asymptotics [[8} 114], 
which typically arise from BMAP/GI/1 queues with subexponential service times and/or batch 
sizes oniim As far as we know, there are no studies on the error estimation of the aug¬ 
mented truncation of Markov chains with subgeometric ergodicity, except for Liu lfl2l ’s work. 
Liu HT21 derived a total-variation-distance error bound for the stationary probability vector of the 
last-column-augmented northwest-comer truncation of a monotone and polynomially ergodic 
Markov chain in discrete time. 

In this paper, we consider a block-monotone Markov chain under the drift condition pro¬ 
posed by Douc et al. 0, which covers polynomial ergodicity and other types of subgeometric 
ergodicity. We first derive an upper bound for the total variation distance between the station¬ 
ary probability vectors of the original Markov chain and its LC-block-augmented truncation, 
which is the main result of this paper. We also present a similar bound in the case where 
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the original Markov chain itself may not be block monotone but is block-wise dominated by 
a block-monotone Markov chain satisfying a modified drift condition with a larger tolerance 
for boundary exceptions. The modified drift condition strengthens the applicability of the ob¬ 
tained bound. Finally, we provide a detailed procedure for establishing our error bounds for the 
LC-block-augmented truncations of block-monotone GI/G/l-type Markov chains. 

The rest of this paper is divided into five sections. Section [2] provides preliminary results 
on block-monotone stochastic matrices. Section [3] presents the main result of this paper. Sec¬ 
tion 0 contains the extension of the main result to possibly non-block-monotone Markov chains 
that are block-wise dominated by block-monotone Markov chains satisfying the modified drift 
condition. Section[5]considers the application of the extended result to block-monotone GI/G/1 - 
type Markov chains. Finally, Section [6] provides concluding remarks. 


2 Preliminaries 


Let {(X y , J„); v G Z + } denote a Markov chain with state space F = Z + x D, where Z + = 
{0,1,2,...} and D = {1,2,..., d} C N := {1,2,...}. Let P := (p(k, i;£, j))(k,i),(e,j)ev 

denote the transition probability matrix of the Markov chain {(X v , i.e., 

p(k,i;£,j) = P(X U+1 = £,J U+1 = j \ X v = k,J u = i), (k,i]£,j) G F 2 , 


where (k,i;£,j) represents ordered pair (ik. i). {£.])). Note here that P is row stochastic 
(stochastic, for short, hereafter), i.e., Pe = e, where e denotes a column vector of l’s of 
an appropriate order. 

For n G N, let ( n ) P n := (( n )Pn(k , i; £,j))(k,i),(fj)e f denote a stochastic matrix such that, for 

i,j e D, 


(n)Pn(k, i] £,j) 


' p{k,i\£,j), ke Z+, £ = 0,1,... ,n- 1, 

oo 

< p(k, i; m,j), k G Z + , £ = n, 

m=n 

0, otherwise. 


( 2 . 1 ) 


By definition, P and < n )P n can be partitioned into block matrices with size d. Furthermore, 
(12.11) implies that ( n )P n is in the following form: 


(n) 


P n = 


n 

F\F^ n 


F 

(n)i 

(n) J 




>^n 


F\F^ n 

O 

O 


( 2 . 2 ) 


where F ;n = {0,l,...,n}xB and O denotes the zero matrix of an appropriate order. Equation 
(12.21) shows that the sub-state space F \ F^ n of ( n )P n is transient and thus the submatrix ( n ) P* 
of ( n )P n does not have any contribution to the stationary probability vector of ( n) P„. There¬ 
fore, we call the whole matrix t n )P n the last-column-block-augmented (LC-block-augmented) 
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northwest-corner truncation ( LC-block-augmented truncation, for short). The LC-block-augmented 
truncation ( n )P n is also called the last-column-block-augmented first-n-block-column trunca¬ 
tion in m. It should be noted that, since ( n) P^ n in (12.21) is a finite stochastic matrix, the 
LC-block-augmented truncation ( n )P n always has at least one stationary probability vector (see, 
e.g., m Chapter 3, Theorems 3.1 and 3.3]), which is denoted by ( n )7r n := (( n )7r n (fc, i))( fci j) eF . 

We now assume that Pis irreducible and positive recurrent. We then define 7r := (n(k, i))(k,i)ew 
as the unique stationary probability vector of P. We also assume, unless otherwise stated, that 
P is block monotone with block sized d (see lH8l Definition 1.1]), i.e., 

OO OO 

P(fc; m) < P(k + 1; m), fc,(eZ + , (2.3) 

m=£ m=£ 

where P(k;£) := (p(k, i\l, j)) ijeD is the (k,i )th block of P. To shorten the statements on 
block monotonicity, let BM, ; denote the set of block-monotone stochastic matrices with block 
size d. It then follows from P e BMj that a stochastic matrix Ylm=o P(k',m) is constant 
with k G Z + (see [18] Proposition 1.1]). Furthermore, since P is irreducible, the stochastic 
matrix := J2m =o P(£"- rn ) I s irreducible and thus has the unique stationary probability vector, 
denoted by zu := (w(i)) ieS ,. 

Finally, we introduce some symbols and definitions related to block monotonicity. Let 


( Id 

O 

o 

o 

... \ 


( 

Id 

o 

o 

o ■■■\ 

Id 

Id 

o 

o 




-Id 

Id 

o 

o 

Id 

Id 

Id 

o 


J 1 - 1 — 

> ■ L d — 


o 

-Id 

Id 

o 

Id 

Id 

Id 

Id 




o 

o 

-Id 

Id 

V : 




••• ) 


V 




••• ) 


where Id denotes the d x d identity matrix (we write I for the identity matrix whose order is 
clear from the context). Note here that (12.31) is equivalent to 

T-'PT, > O. 


Definition 2.1 A column vector / = ( f(k , i))(fc i q gF with block size d is said to be block in¬ 
creasing if T d l f > 0, i.e., f(k, i ) < f(k + 1, i) for all ( k , i) G 7L+ x ID). We denote by B\ d the 
set of block-increasing column vectors with block size d. 


Definition 2.2 A probability vector := (/i(/c, i))(k,i)ev with block size d is said to be block- 
wise dominated by a probability vector r] := (?7(&A))(fc,qeF (denoted by pL -< d rj) if [iT d < 
■qT d . Similarly, a stochastic matrix P\ := (pi(/c,i; j))(k,i),(t,j)c¥ with block size d is said 

to be block-wise dominated by a stochastic matrix P 2 := (p 2 (^, F f, j))(k.i),(e,j)e¥ (denoted by 
Pi -dd Pi) if P Td A P 2 T d . 
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It is known that if P e BM d then ( n ) P n -< d P and thus ( n )7r„ -< d n (see [18, Proposi¬ 
tion 2.3]), which leads to 

OO OO 

y ^An^njk.i) =y^ y n(k,i) = w{i), ieD. (2.4) 

k =0 k =0 


3 Main result 


This section presents an upper bound for ||( n )7r n — 7r||, where || • || denotes the total variation 
distance, i.e., 

|| (n)TTr i || ^ ^ | (n)'^n{k J i p) I • 

(fc,i)GF 

Letp m (fc,z) := (p m (k,i]£,j)) {ej)eV and {n) p™(k,i) := ((n)P™(M;^j))(A0e f denote proba¬ 
bility vectors such that p m (k, i ; £,j) and ( n )P™(k, z; £,j) represent the (fc, z; f, j)th elements of 
P m and (( n )P„) m , respectively. For any function <^(-, •) on F, let ip(k, zu) = JA D m(i)ip(k, i ) 
for fceZ.|_. We then have 


(n )7T n - 7T11 < ||p m (0,ra) - 7T|| + ||(n)P™(0,T!7) - („)7T n || 

+ \\(n)Pn (0,W) -p m (0,tu)|| . (3.1) 


It also follows from the second last inequality in the proof of [112, Theorem 3.1] that 


(n)Pn (0,-07) -P m (0, zu)\\ < 2m ^ (n )7T n (n, z). 

iGD 


(3.2) 


To estimate the first and second terms on the right hand side of (13.11) . we assume the sub¬ 
geometric drift condition proposed in [3|, which is described in As sumption 13.11 below. For the 
description of the drift condition, let 1 K = (l K (k,i))^ k: i) £¥ , K e Z + denote a column vector 
such that 


Ik-(M) 


l, (M)eF^, 

0 , (k,i)e F\F^ k 


In addition, for any scalar-valued function 6 on (—oo, oo) and any real-valued column vector 

a := (a(z)), let 6 o a = (6 o a(z)). 


Assumption 3.1 (0, Condition D(0, V, P)]) There exist a constant b 6 (0, oo), a column vec¬ 
tor v = (v(k, z))(fc,i)eF ^ Bl,; with v > e, and a nondecreasing differentiable concave function 
<f> : [1, oo) —y (0, oo) with lim^oo 4>'{t) = 0 such that 


Pv < v — (j) o v + bio- 


( 3 . 3 ) 
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Remark 3.1 If lim^oo fit) = c for some c > 0, then Assumption 13.11 is reduced to the 
geometric drift condition (see [[3] Remark 1] for the details): There exist b G (0, oo), 7 G (0,1) 
and a column vector v G Bl (i with v > e such that 


Pv < yv + 51 0 , 


which is assumed in the related studies [f71 fl 8 l [24]. 

Under Assumption 13.11 the irreducible stochastic matrix P is subgeometrically ergodic if 
P is aperiodic []3l Proposition 2.5]. However, we do not necessarily assume the aperiodicity of 

P. 


We now introduce some symbols according to [j3l Section 2]. Let II 0 denote a function on 
[ 1 , 00 ) such that 



(3.4) 


Clearly, Ip, is an increasing differentiable concave function, and II 0 (x) = 00 due to 

the concavity of 0 (see (31 section 2]). Thus, the inverse Hf 1 : [0, 00 ) —> [1, 00 ) of H$ is well- 
defined and lim^oo Hf x (x) = 00 . Furthermore, it follows from (13.41) that II (t 1 is an increasing 
differentiable function and 


rpx) := (#/)'(z) = (poH^tx), x > 0 . 


(3.5) 


The function r 0 is nondecreasing because 0 is nondecreasing and II 0 1 is increasing. In addition, 
it follows from (3l Proposition 2.1] that r & is log-concave. For convenience, we define r 0 (x) = 0 
for x < 0. 

In what follows, we present two lemmas and the main result of this paper. 

Lemma 3.1 Consider the Markov chain { (X u . ): v e Z + } with state space F and transition 
probability matrix P, and let r 0 f = i 11 f {// G N; X v = 0}. If P G BM* P is irreducible and 
Assumption I3.il holds, then 


E(fc,i)[r>(r 0 + - 1)] < v(k V 1 ,i), ( k,i ) G F, 

E 7 r['^(^o + _ !)] < v ( k v 1,^), k G 


(3.6) 

(3.7) 


where x V y = max(i, y) and 


E tt[• ] — Tr(k,i)E( kji) [-], 


(k,i) SF 


E(fc,j)[- ] = E[- | X 0 = k, J 0 = i], ( k,i ) G F. 


Proof. We first prove (13.61) . Note that 


V n + -1 



E (k,i)[rpr+ - 1)] < E (fc)i ) 


(k,i) G F. 


(3.8) 
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It then follows from 0 Proposition 2.2] that 




Y r 


n =0 


< v(k, i ), k G N, i G 


(3.9) 


Furthermore, 



V-i 


V- 1 

E(o ,0 

Y r ^ 

n =0 

— E (k,i) 

Y r 

77—0 


k e N, i e D, 


(3.10) 


which follows from the pathwise-ordered property [HI Lemma A.l] of the block-monotone 
Markov chain {( X UJ ./„)}. Combining (13.91) and (13.101) . we have 




T?-l 


Y r ^( n ) 


n =0 


< v(k V 1, i), (k , i ) e F. 


(3.11) 


Substituting (13.1 II) into (13.81) . we obtain (13.61) . 

Next, we prove (13.71) . It follows from [22] Theorem 10.4.9] that, for any function <£>(•, •) on 
F such that S( fcii ) e!F 7r(M)l</ ? (M)| < oo, 


Y n(k,i)(p(k,i) = 5^7r(0,i)E (o ,i) 

(fc,*)GF 


iee 


Note here that - 1)] = Xinio 1 Ar >( n ) > where Ar 0 (n) = r^in) - r 0 (n - 1) for 


V - 1 


^ ^ (^(Aj/, J v 


u=0 


(3.12) 


n 


G Z+. Thus, letting <p(k, i ) = Ar^n)] in (13.121) . we obtain 


E,tMt 0 + - 1)] = e 7 


Y Ar >( n ) 


n=0 


^7 r (°A)E 


( 0,0 




^2 e (x v ,j„) 

u=0 


t'o'M - 1 

A? >( 




(3.13) 


where r 0 f (i/) = inf {rt > // + 1: A„ = 0}. Changing the order of summation on the right hand 
side of (13.131) . we have 

- 1 )] 

= 5^7r(M E (o,i) 


iGD 


T 0 _1 n 


Y^ ^(0, *)E(o,t) 


ieB 


Y Ar *( n ) 

n =0 u=0 

Y r >( n ) 


n =0 


— ^ ^ ^00 E(fc,z) 

V- 1 

7GD 

71—0 


k e Z+,(3.14) 
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where the last inequality follows from (13.101) and 7 r( 0 , i) < w(i) for j 6 D (see (12.41) ). Applying 
(13.1 II) to (13.141) yields (13.71) . □ 

Using Lemma |3T] we prove the following lemma. 


Lemma 3.2 Suppose that P G BM,/ and P is irreducible. If Assumption 1 3. 1] holds, then, for 
all k G Z + and m G N, 


\\p m (k,zu) - tt|| < 

II (n)Pn ik,ru) - ( n )7T n || < 

where the function r 0 is given in ( U.5I) . 


4 

- 1 ) 
4 

r4,(02 - 1 ) 


v{k V 1. zu), 
v(k V 1, zu), 


n G N, 


(3.15) 

(3.16) 


Proof We first prove (13.151) . Let r 0 = inf {rt G Z + ; X n = 0} and P(k,i)( • ) = P( • | A " 0 = 
k, Jo = i) for (k, i ) G F. Following the derivation of fl8l Eq. (3.22)] and replacing v by e, we 
have 


\\p m (k,zu) 7T|| < 2y^c7(i)P( fc|i) (To > m) + 2 ^ tt(£, j)P (4?) (r 0 > m) 

*gd (e,j)e f 

< 2^ w(i)P (Ki) (r^ > m) + 2 7r(^,j)P(^)(' 7 o” > m)> (3-17) 

where the second inequality follows from the fact that Pyyfjo > tn) < P(A/)( r o~ > tn) for 
m G N and (£,j) G F. Using Markov’s inequality, we have 

p «J)( T o + > m) < - 1)], m G N, (£,j) G F. 


Thus 


| p m (k, zu) — 7r|| < 


r 0 (m - 1) 


^tu(i)E (M [r 0 (r o + - 1 )] + E^[r 0 (r o + - 1)](3.18) 


,ieID> 


Applying Lemma [3711 to (13.181) yields (13.151) . In addition, since ( n )P n -<d P and v G Bl d , it 
follows from (13.31) and [18., Remark 2.1] that 


(. n )PnV < PV < V — (j) O V + 61 0 . (3.19) 

Therefore, (13.161) can be proved in the same way as that of (13.151) . The details are omitted. □ 

Theorem 13.11 below presents upper bounds for ||(„) 7 r n — 7 r||, which are the main result of 
this paper. 
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Theorem 3.1 Suppose that P G BM,/ and P is irreducible. If Assumption 15. 1 1 holds, then, for 
all n, m G N, 


(n)^"n 7T 


< 


r>(m - 1) 


+ 2m E (n)ttn( n j i)i 


ieD 


< 


- 1) 


;(1, zu) + 2 mb 


iei 


0 o v(n, i ) ’ 


(3.20) 

(3.21) 


where the function r 0 is given in ( U.5D . 


Proof. Substituting (13.21) . (13.151) and (13.161) into (13.11) . we obtain (13.201) . Furthermore, pre¬ 
multiplying both sides of (13.191) by ( n )7r n , we have 

Y (n)7 T n (k,i) ■ (f>ov(k,i) <b, 

(fe,i)G F 


which leads to 


(n)1tn{jli i') E 


Combining (13.201) and (13.221) yields (13.211) . 


b 

0 o i?(n, i) 


(3.22) 

□ 


Remark 3.2 Suppose that lim^oo 0(f) = oo and lim k _ ) . 00 v(k,i) = oo for all i G B. It then 
holds that lim, woo 0o v(n, i) = oo for i G D. Thus, it follows from (13.221) that lim, woo ( n )7r n (n, i) 
0 for i G D. Recall here that Hi 1 (x) = oo. Applying this and Hindoo 0(f) = oo to 

(13.51) yields lim^oo r 0 (x) = oo. Therefore, we can reduce the error bounds (13.201) and (13.211) 
to any desired value less than two by fixing m G N sufficient large and then choosing n G N 
large such that the bounds take the desired value. 


4 Extension of the main result 

In this section, we extend Theorem 13. II to the case where P may not be block monotone but 
is block-wise dominated by a block-monotone stochastic matrix P = (p(k,v, £, j))(k,i),(e,j)ev- 
Note here that P G BM^ is allowed to be equal to P and thus P G BM,/. 

Let P m := ( p m (k , i; £,j))(k,i),(i,j)ev, tn G N denote the mth power of P. For k, £ G Z + , let 

P m (k; £) := {p m {k,f£,j)) i>j& denote the (k,£) th block of P m . We then have the following 
result. 

Theorem 4.1 Suppose that (i) P <<i P G BM,/ and P is irreducible; and that (ii) there 
exist a constant b G (0, oo), a column vector v = (v(k, i))(k,i)ew £ Bl d with v > e and a 
nondecreasing differentiable concave function 0 : [l,oo) —> (0, oo) with lim^ oo 0 / (f) = 0 
such that, for some M G N and K G Z + , 

P M v < v — 0 o v + blx, 

P m (K; 0)e > 0. 


(4.1) 

(4.2) 
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Let B denote a positive constant such that 

B ■ P m (K ; 0)e > be. 

Under these conditions, the following bound holds for all rri, n G N. 

8{c 0 , s (l)}~ 1 r ~ v- 1 


| (n) '^n 11 — 


——-{d(1, zu) + B} + 2 mMb ^ 


where 


° c^ B {jn - 1 ) 


0 ( 1 ) 

CcP,b{x) = 1/r , , lN x, x > 0 . 


iei 


0 o x(n, i) ’ 


0(5 + 1) 

In addition, if K = 0, then, for all m, n G N, 


7T„ - 7T < 


| (n)'*n 


which holds without 44.21) . 


r 0 (m - 1) 


;(1, •cu') + 2 mMb 




o v[n,i) 


(4.3) 


(4.4) 


(4.5) 


(4.6) 


Remark 4.1 Although the condition (14.21) ensures the existence of a constant 5 G (0, oo) 
satisfying (14.31) . it may seem that the condition (14.21) weakens the applicability of Theorem 14. II 
However, that is not necessarily the case. To verify this, we assume that all the conditions 
of Theorem 14.11 are satisfied, except for (14.21) . and that P is aperiodic. Note here that the 
aperiodicity of P does not make any restriction because (I + P )/2 and (I + P) /2 are aperiodic 
and 

7r(/ + P)/2 = 7T, 7r(I + P)/2 = 7T, 

(/ + P )/2 -< d (/ + P)/ 2, (/ + P)/2 G BMj. 

We also assume the following mild condition. 

lim 0 o v(k , i) = oo for all j G D. 

k —^oo 

Under these conditions, let {h m . tn G N} and {/V„,; rri GN} denote sequences such that 6, = 6, 
A, = Ji and, for m — 2,3, , 

b rn = j& + b m - 1 - (1 - A) min 0 ° x(0,i)| V 0, 

JT m = inf {fc gN; (H i)e — (1 — A)0 o -u(fc) < 0} — 1, 

where A G (0,1) is fixed arbitrarily. It then follows from (14.11) that 

pmM v < v _ \(j) o v _|_ b m l Km , m G N. 

In addition, the aperiodicity of P implies that for any rri G N there exists some z/ 0 ( K rn ) G N 
such that P u (K m ; 0)e > 0 for all i/ > u 0 (K m ) (see, e.g., |[2l Chapter 2, Theorem 4.3]). As 
a result, if there exists some m G N such that u 0 (K m ) < mM, then we can obtain a bound 
similar to (14.41) by using Theorem 14.1[ 
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Proof of Theorem 1 4.1\ Let {( X v , v G Z + } denote a block-monotone Markov chain 

with state space F and transition probability matrix P. Conditions (i) and (ii) imply that P is 
irreducible and positive recurrent and thus has the unique stationary probability vector, denoted 
by 7r = ( 7 ? (k, It follows from P -< d P G BM ( / and [18l Proposition 2.3] that n -< d n 

and thus 

OO OO 

7r (fc, i) = 7r(fc, i) — w(i), jgD. (4.7) 

k= 0 fc=0 

Following the last part of the proof of [IS Theorem 4.1], we have 

\\(n)Pn{0,zu) - p m (0,zu)\\ <2m^2 {n) TT n {n,i), me N. (4.8) 

ieB> 

It follows from (14.81) and the triangle inequality that, for m G N, 

||(n)7T„ - 7r|| < ||p mM (0,w) - 7r|| + || (n)P™ M (0, Zu) - ( n) 7T n || 

< ||p mM (0,w) 7T 11 + || (n) p" M (0,^) - (n)7Tn|| + 2mM ( n) 7T n (ra, «Q4.9) 

iGD 


For n e N, let ( n )P n {( n )Pn(k, i\ £, j))(k,i),(fj)& denote a stochastic matrix such that, for 
ij e D, 


e n)Pn(k,T,f,j ) 


r p(k,r,£,j), 

OO 

< ^2p(k,i]m, j), 


m=n 



k G Z + , £ — 0,1,..., n — 1, 
fc G Z+, t = n, 

otherwise. 


Note that ( n )P n is the LC-block-augmented truncation of P. Note also that ( n )P n -<d P G BM d . 
Thus, it follows from [IS Proposition 2.3] that (( n )P n ) M -< d P M . Using this relation together 
with v e Bl (i and [H8l Remark 2.1], we obtain 


(, (n)Pn) M V < P M V. 


(4.10) 


Combining (14.11) and (14.101) . we have 

(( n)Pn) M V < P M V < V - (j) O V + bl K . 


Pre-multiplying this inequality by („)7r n yields 


(n)'^n(Pi k) C 

Substituting (14.1 II) into (14.91) results in 


O V[71, l) 


% e 


(4.11) 


|( n) 7T n - 7r|| < ||p mM (0, ZU) - 7r|| + ||( n )Pn M (°> 

+ 2 mMb 


(n) n | 


, rs 1 1 / ryt n \ 


(4.12) 
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We now define {(Xj/' f> , J^); v G Z + } as the M-skeleton of the Markov chain { (X u , «/„); v G 
Z + } with transition probability matrix P, i.e., 

xl M) = x vM , = Xm, !/ g z + . 

Clearly, the M-skeleton { (xl M> , evolves according to P M . We also define Tq M ^ + = 

inf{z/ G N; = X u m = 0}. Proceeding as in the derivation of the first inequality for 

|| p m (k, zu) — 7 r||„ at page 97 of llT 8 Tl (replacing v by e as in the derivation of (13.171) 1 and using 
(14.71) . we obtain 

\\p mM (k, zu) - 7T11 < 2 y~]g 7 (i)P( fc|i ) (f 0 (M)+ > m) 

ie D 

+ 2 ^ tt(^, j)P ( rj)(ro M)+ > m), k G Z+, m G N,(4.13) 

(9i)GF 

where P( fc)i )( •) = P( • | X 0 — k, J 0 — i) for (k, i ) G F. In addition, by Markov’s inequality, 

hM M)+ >™) < !) ^4) h( ? o Af)+ - !)]> m G N, (£,j) G F, (4.14) 

where 

E„,,)[•] = ![. I x„ = <,J 0 = j], (t,j) e F. 

Substituting (14.141) into (14.131) . we have, for m G N, 

||p mM (fc, izr) — 7r || 

- r^m — 1 ) fe Mr 0 (M)+ - 1)] + Es [r>(r 0 (M)+ - l )]\ (4-15) 

where 

Erf [ • ] = v(k,i) E (m) [-]. 

It should be noted that if K = 0 then Lemma [3TTI yields 

E( fc ,i) [^(r 0 (M)+ - 1)] < u(A: V 1, i), (k, i) G F, (4.16) 

Eg [r 0 (f o (M)+ - l)] < v(k VI ,zu), k G Z+. (4.17) 

Combining (14.151) with (14.161) and (14.171) . we obtain 

\\p mM (k, zu) — 7 r|| <—7 - z v {k V 1, xct), m G N. (4.18) 

r^(m-l) 

Similarly, we have 

||(n)P™ M (fc,^) - (n)7Tn|| < — — u(A) V 1, Tu), 171, 17 G N. (4.19) 

" " r^m — 1 ) 
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Substituting (14.181) and (14.191) into (14.121) yields the bound (14.61) in the special case where K = 0. 

In what follows, we consider the general case, where K 6 N. In fact, the following inequal¬ 
ity holds (which is proved later): 


where 


P M v < v — (j) o v + bio, 

(4.20) 

M bIiT X) ' 

x > 1, 

(4.21) 

b = b + B, 


(4.22) 

5(M = { t , ‘>' 

( v(k,i) + B, 

k — 0, igD, 
k e N, i e D. 

(4.23) 


Since v e Bl fi and (( n )P n ) M -< d P M , we have (( n )P n ) M v < P M v (see l!T8l Remark 2.1]). It 
follows from this inequality and (14.201) that 


(( n)Pn) M v < P M v <v - 4>ov + bl 0 . (4.24) 

Note here that </> : [1, oo) —> (0, oo) is a nondecreasing differentiable concave function such 
that lim^oo (fit) = 0. The inequality (14.241) implies that the case where K e N is reduced to 
the special case where K = 0. 

To follow the proof of the case where K = 0, we define two functions H~ and r~, which 
correspond to the functions II 0 and r 0 , respectively. Let IT- denote a function on [1, oo) such 
that 

H fa) = [ = { c <t>A l )}~ lH 4 >{ x ), x>l, (4.25) 

J i nv) 

where the second equality results from (13.41) . (14.51) and (14.211) . Furthermore, let rr denote a 
function on [0, oo) such that 


r^(x) = 4> ° H~ 1 {x) 1 x > 0. 

We then have 

rfa) = C *A l)-(p°H~\x) 

= c^ B { 1) •0of/" 1 (c^ B (a;)) 

= c^ B { 1) • o c^ B (x), x > 0, (4.26) 


where the first, second and third equalities follows from (14.211) . (14.251) and (13.51) . respectively. 
In addition, following the derivation of (14.181) and using v in (14.231) and r~ in (14.261) (instead of 
v and r^), we obtain 

II p mM (k, Vj) — 7r|| < -- -rrv(k V 1, Zu) 

ii ii r ~( m - 1) 

= 1 { v (k VI, tv)+ B}, kez + . (4.27) 

° Cfa B (m - 1 ) 
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Similarly, 

\\ { n)Pn M (k,Zu) - ( n )7T n || < J v(k V 1,07) + 5}, k G Z^(4.28) 

Substituting (14.271) and (14.281) into (14.121) yields (14.41) . 

It remains to prove that (14.201) holds. For k e Z + , let v(fc) = (n(fc, i)) ieD and v(fc) = 
(v(k,i)) ie0 , i.e., 

17T = (^ T (0), ^ T (l), ^ T (2),...), £ T = (£ T (0), £ T (1), ^(2),...), 

where the superscript “T” denotes the transpose operator for vectors and matrices. It then 
follows from (14.11) . (14.221) and (14.231) that 

OO OO 

P M ( 0; Z)v{£) < ^ M (°; < t7(0) - (/> o v(0) + {b + 5)e 

£=0 1 =0 

= v(0) — 0 o i;(0) + fee < v(0) — 0 o v(0) + be, (4.29) 

where the last inequality holds because 0(x) > 0(x) for x > 1 (see (14.211) 1. 

It should be noted that P M e BM ( / due to P e BIV^. Thus, P M (k ; 0) > P M (K ; 0) for 
k — 0,1,..., K. Using this and (14.231) . we have, for k — 1, 2,..., A", 

OO OO 

P M (fc; ^)«(£) = ^ P M (k] £)v{£) + 5{e - P M {k- 0)e} 

£=0 £=0 

OO 

< P M (k-, £)v{£) + B{e - P M (K ; 0)e}. (4.30) 

£=0 

Applying (14.11) and (14.231) to the right hand side of (14.301) yields, for k — 1,2,... ,K, 

OO 

P M (k] £)v{£) < v(k) - 0 o v(k) + be + B{e - P M (K ; 0)e} 
e=o 

= v(k) - 0 o v (k) + be- BP m (K ; 0)e. (4.31) 

Note here that the nonnegative concave function 0 : [1, oo) —> (0, oo) is log-concave and thus 

d f<t>(x — B)\ 0(x — B) /0'(x — 5) 0'(x)\ 
dx \ 0(x) ) 0(x) \ 0(x — B ) 0(x) / 

= s log ^ B) ~ s log ^} - °- 

Therefore, it follows from (14.211) that 

0(g - £) > 0(1) _ 0(g) 

0(x) “0(5 + 1) 0(x)’ 


x > 5 + 1, 
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which leads to 


4>(x) < 4>(x — B), x > B + 1. 

(4.32) 

In addition, from (14.231) and v > e. we have 


v(k) = v{k) + Be > (B + l)e, k G N. 

(4.33) 

The inequalities (14.321) and (14.331) implv that 


0 o v(k) < 0 o v(k), fceN, 

(4.34) 


where 0 ° v(k) — (0 o v(k, i)) i€ Substituting (14.341) into (14.311) and using (14.31) . we obtain 

OO 

^P M {k-f)v(f) < v(k) -4>ov(k) + {be- BP M (K'0)e} 
t=o 

<v{k) — (j) ov(k), k — l,2,...,K. (4.35) 

Similarly, it follows from (14.11) . (14.231) and (14.341) that, for k — K + 1, K + 2,..., 

OO OO 

P M (k; e)v{£) < P M ^ £ ) v ( £ ) + Be < v{k) -(f) o v{k) + Be 
z=o e=o 

= v{k) — <fi o v{k) < v(k ) —(f) o v(fc). (4.36) 

As a result, combining (14.291) . (14.351) and (14.361) results in (14.201) . □ 


5 Applications to GI/G/l-type Markov chains 

In this section, we discuss the application of our results to block-monotone GI/G/l-type Markov 
chains. We first present a procedure for establishing an error bound for the LC-block-augmented 
truncation of a general block-monotone GI/G/l-type Markov chain. We then consider such a 
simple special case that the parameters of the error bound are specified. 

5.1 General case 

In this subsection, we consider a general block-monotone GI/G/l-type Markov chain, which 
satisfies the following assumption. 

Assumption 5.1 

(i) P G BM, ; is an irreducible GI/G/l-type transition probability matrix such that 



B( 0) 

B(l) 

B(2) 

5(3) 


A(-l) 

A(0) 

A(l) 

A(2) 

P = 

A(—2) 

A(-l) 

A(0) 

A(l) 


A(-3) 

A(-2) 

A(—1) 

A(0) 


V i 5 i i ••• 


(5.1) 
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where A(—k ) = Ylt=-oo f° r k £ Z + and the diagonal blocks A(0) and B( 0) are 
d x d matrices; and 

(ii) A := YlkL-oo A(k) is an irreducible stochastic matrix. 


Remark 5.1 The GI/G/l-type transition probability matrix P in (15.11) above is equal to P 
in (5.1) of Ifl8l . though the latter has the block matrices {£?(0), B(— 1), B(— 2),... } in the 
first block column. Indeed, for all k £ N, B(—k ) must be equal to A(—k) because A = 
B(—k ) + YlT=-k+i due to P £ BM^ (see [18; Proposition 1.1]). 


It follows from (15.11) . P £ BM (/ and [18, Proposition 1.1] that, for all k £ Z + , 


OO OO OO 

* = X ™) = X B w = X 

m =0 £=0 £=—oo 


A. 


Recall here that vj is the stationary probability vector of V P and thus A. Using zu. we define cr 
as 

OO 

cr = zu kA(k)e. (5.2) 

k=— oo 

We then assume the following. 


Assumption 5.2 a < 0. 


Under Assumptions 15.II and 15 .21 the GI/G/l-type transition probability matrix P in (15.11) is 
irreducible and positive recurrent (see, e.g., flTl Chapter XI, Proposition 3.1]) and thus has the 
unique stationary probability vector n = ( 7 r(/c, i))^,*)^. 

The subject of this subsection is to show how to obtain an upper bound for ||( n )7r n — 7r|| 
by using Theorem |4.1[ To apply Theorem 14.II to P in (15.11) . we have to prove that the drift 
condition (14.11) holds with P being equal to P, that is, P M v < v — cf)ov + bl K . Unfortunately, 
since it is not easy to establish directly the drift condition on P M , we construct a modified 
transition probability matrix from P and establish a similar drift condition on the Mth power 
of the modified transition probability matrix. Using the similar drift condition, we derive the 
desired drift condition on P M . 

We define the modified transition probability matrix mentioned above. For iV e N, let 

P N := (pN(k, i ; £,j))(k,i),(e,j)e f denote a stochastic matrix such that 


f B( 0) B(l) B( 2) 

An(— 1) Aat(0) Ajv(1) 


B( 3) 
A n {2) 


• \ 


Pn = 


A n (-N ) A n (—N + 1) A n (—N + 2) 
O A n (-N ) A n (—N + 1) 

O O A n (-N ) 


An(—N + 3) 
A n (-N + 2) 
A n (—N + 1) 


5 


V 


••• 


(5.3) 
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where A N (k), fceZ:= {0, ±1, ±2,... } is given by 

[O, k < —N — 1, 

A N (k) = l A(-N), k = -TV, (5.4) 

l A(k), k > -TV + 1. 

It follows from (15.31) and Assumption l5.1l that P -< d P N G BM,/ for TV G N. Furthermore, let 

OO 

On = izr kAN(k)e. (5.5) 

k=—oo 

Assumption l5.2l implies that, for all sufficiently large TV G N, 


ctat < 0. (5.6) 

In the rest of this subsection, we fix TV G N such that (15.61) holds. For M G N, we then define 
{A^ // (/c); k G Z} as the A/th-fold convolution of { A N {k ); k G Z}, i.e., A*jf(k) = A N (k) for 
k G Z and, for M > 2, 

A)f(A;) = ^ A^ M - 1] (fc - f)A,v(f), k G Z. 

l&L 

From (15.41) . we have A^ik) = O for all fc < — L — 1, where L = MTV. We also obtain the 
following result. 


Lemma 5.1 There exists some Mo G N such that 

OO 

< 0 for all M > M 0 . (5.7) 

t=-L 


Proof. We consider a Markov additive process {(Y u , -If: v G Z + } with state space ZxD and 
kernel { Av(A'): k G Z}, which evolves according to the following transition law. 

P(Y V+1 - Y v = k, J u+ 1 = j | J„ = i) = ^(fc)]^-, k G Z, i,j G D, 

where [-j^ denotes the (i,j)th element of the matrix in the square brackets. Note here that 
zu is the stationary probability vector of the background Markov chain { J u ; v G Z + } and thus 
on < 0 is the mean drift of the marginal process {!),; v G Z + }. In addition, it follows from 
on < 0 that P(lim I/ _ > . oo y i/ = —oo | Y 0 — i) — 1 for all i G D (see, e.g., (JT] Chapter XI, 
Proposition 2.10]). Therefore, (15.71) holds for some M 0 G N. □ 


To proceed, we fix M > M 0 arbitrarily, where M 0 is some positive integer satisfying (15.71) . 
We denote by Pff (k\ £), k. £ G Z + the (k. ()th block of the A/th power Pf r of Pn It then 
follows from (15.31) that 


f A* N M (l-k), k>L, £>k-L 
\ O, k > L, £ < k — L — 1 
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and thus 


p"(0|0) 

Ptf{ 0; 1) 

p"(0| 2) 

P"(0;3) 

P?(i;0) 

W; i) 

Py(l;2) 

f’iv'(i;3) 

P«(L—1;0) 

Ptf(L- 1;1) Pn(L - 1; 2) 

P$(L- 1;3) 


A*™(-L + 1) A$*(-L + 2) 

A’ n m (-L + 3) 

o 

A* n m (-L) 

A* n m (-L + 1) 

A’ n m (-L + 2) 

O 

o 

A* n m (-L) 

A% m (-L + 1) 


V : : : : ■■■ 

Since P -< d Pn £ BM,/, it follows from [ 18, Remark 2.1 and Proposition 2.3] that P M < d Pff, 
which implies that 

P M v < P^v ifv£B\ d . (5.9) 

Therefore, we show that P^ satisfies a drift condition similar to (14.11) . 

We now introduce a function V : [0, oo) — > [1, oo), which plays a key role in establishing 
the drift condition on Pff . 


Assumption 5.3 There exists some a £ [0,1) such that, for any 5 > 0, 

1 


lim /1 \ 

k—¥oo V \k) 


£ V{k + l)A'M(l)e = 0, 


(5.10) 


r=L5fci-“j+i 


where V : [0, oo) —> [1, oo) is an increasing, convex and log-concave function such that 
(i) lim^oo(log V(x))/x = log r A+ , where 

r A+ = sup [z > 1; Y1T= o ^A{1) is finite} ; 


(ii) V(x) is twice-differentiable for x > 0; 

(iii) r(0) := finixio V\x) > 0 and liin^^ V'{x) = oo; 

(iv) V"(x)/V'(x) is nonincreasing for x > 0; and 

(v) limsup^o lim^oo V'{x + <5x 1_ “)/ V'{x) = 1. 


Remark 5.2 Appendix lAl provides a sufficient condition for Assumption 15.31 and the typical 
examples of V. 

The key properties of the function V are summarized in Lemmas [5.21 and [5731 below. 
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Lemma 5.2 Suppose that Assumption I5.il is satisfied. It then holds that, for any a 0 G (a, 1), 

V'(x) = exp{o(a: ao )}, (5.11) 

where f(x) = o(g(x)) represents linx*,.**, f(x)/g(x) = 0. It also holds that 


logV (a;) = o(x a °). 


(5.12) 


In addition, 


, V”(x) 

lim WT = °- 
HOO V [x) 


(5.13) 


Proof. We first prove (15.1 II) . Let G denote a continuous function on [0, oo) such that 

^(0) 


G(x) = 1 - 


Vfx) 1 


x > 0. 


Since V' is nondecreasing and lini.,.^^ V'(x) = oo (due to the convexity of V and condition 
(iii) of Assumption 15.31) . G is a distribution function. We now define G(x) = 1 — G(x) for 
x > 0, i.e., 

— y'(o) 

G <*> = v4j’ **“■ 

It then follows from condition (v) of Assumption l5.3l that 


(5.14) 


lim inf lim G( C ^ = 1, 

< 54-0 x->oo G(x) 


and thus, for any a 0 G (a, 1), 


G(x + x 1 “°) G(x + Sx 1 “) 

1 > lim -=—-> lim mf fim -=—-= 1. 

< 54.0 x —>00 


G(x) 


G(x) 


Therefore, we have 


G(x + x 1 Q °) 

lim -=-= 1, 

x ^°° G(x) 


which implies that the distribution function G is (l/ao)th-ordcr long-tailed [17., Definition 1.1 
and Lemma A.3]. Combining this fact with IH71 Lemma A.l (i)] yields 


G(x) = exp{-o(x a °)j. (5.15) 

Substituting (15.151) into (15.141) results in (15.1 II) . Furthermore, using (15.1 II) . we can readily obtain 

(EH- 

Finally, we prove (15.131) by contradiction. To this end, we assume that (15.131) does not hold, 
i.e., there exist some S > 0 and x 0 := x 0 (S) > 0 such that 
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and thus log V'(x) — log V'(x 0 ) > 5(x — x 0 ) for x > x 0 , which yields 

V'(x) 


V'(x 0 ) 


> exp{5(x — xq)}, x > xq. 


Therefore, we have 


V{x) > V'(xq) + 


V'(x 0 ) 


J(x-x 0 ) 


1), X > Xq. 


From this inequality, we obtain lim inf^oo log V(x)/x > 5, which is inconsistent with (15.121) . 

□ 


Remark 5.3 Equation (15.121) shows that log V (x) = o(x). Thus, from condition (i) of Assump- 
tion !5.31 we have r A+ = 1, i.e., {A(k); k G Z + } is heavy-tailed. 


Remark 5.4 As mentioned in Remark l5Tl Masuyama lfT8l considered the same block-monotone 
GI/G/l-type transition probability matrix as P in (15.11) . However, Masuyama Ifl8l assumed that 
r A+ > 1, he., (A(fc); k G Z + } is light-tailed, which implies that (B(k); k G Z + } is also light¬ 
tailed. Indeed, since P G BM d , it holds that YlT=k -B(^) < YlT=k for all k G Z+, which 
yields, for z G [1, r A+ ), 

OO OO OO 

E = E B ( ( > + E(-' - !) s w 

k=0 1=0 1=1 

OO OO OO 

= e am + e< 2 ‘ - z ‘ _1 ) E 

1 =0 fc=l 

OO OO OO OO 

< E +E< 2 ‘ - 2 ‘ _1 ) E = E 

/c=0 

Thus, if r A+ > 1, then r B+ := sup {z > 1; z £ B(l) is finite} > r A+ > 1. It is known (see 
[]8] Theorem 2.2] and [14] Theorem 3.1]) that, under Assumptions lS. 1 I and l5.2l min(r J 4 + , rg + ) > 

1 if and only if the GI/G/l-type transition probability matrix P in (15.11) satisfies the geomet¬ 
ric drift condition (see Remark 13.11) . On the other hand, Assumption 15.31 together with As¬ 
sumptions |5J] and |A2] implies that the GI/G/l-type transition probability matrix P in (15.11) 
is positive recurrent but does not satisfy the geometric drift condition because r A+ = 1, i.e., 
{A(k)\ k G Z + } is heavy-tailed (see Remark 1531) . It is also known (see IfTT! Theorem 3.1]) 
that if { A{k)\ k G Z + } is heavy-tailed then so is the stationary probability vector of the ergodic 
GI/G/l-type transition probability matrix P. Such GI/G/l-type transition probability matrices 
typically arise from BMAP/GI/1 queues with subexponential service times and/or batch sizes, 
and these Markov chains have the subexponential stationary probability vectors under some 
mild technical conditions [15] [HI (see also [|9lIT61). 
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Lemma 5.3 If Assumption |5 . 3 \ holds, then, for any e € (0,1), there exist some d 0 := A (e) > 0 
and positive integer K 0 := Kq(S 0 , L) > L such that 


V'(k + 5 0 k 1 -*) < (1 + e)V'(k), k>K 0 + 1, 

V\k — L) > (1 — e)V'{k), k > K 0 + 1. 


(5.16) 

(5.17) 


Proof Recall that V' is nondecreasing. Thus, it follows from condition (v) of As sumption [53] 
that 


1 > lim 

x—yoo 


V'(x - L ) 
V'{x) 


.AM_> limmf 

y->oo V'yy + L ) <54.0 2 /->o o V'{y + 5y l “) 


lim 


1 , 


which leads to 


, im = i. 

a;—>oo V (X) 


(5.18) 


In addition, condition (v) of As sumption 15 .3 1 implies that, for any e e (0,1), 


V\x + dox 1 a ) 

11111 - T77T~\ -< 1 + 2e i 

x-t-oo V (x) 


(5.19) 


where <5 0 > 0 is sufficiently small depending on e e (0,1). Consequently, (15.181) and (15.191) 
show that the statement of this lemma is true. □ 


To establish the drift condition on P/f, we estimate Pjv (k- f)V(£)e for sufficiently 
large k 's by using Lemmas [531 and [531 Lemma [531 implies that there exist k > 0 and £ e (0,1) 
such that 

OO OO 

(1 - e) £A*^(f)e + 2eJ2 £A% M (i)e < -2ne. (5.20) 

e=—L e=o 

Furthermore, according to (15.101) . there exists some K e { K 0 , K 0 + 1,... } such that 

OO 

—— V Vik + f)A*^U)e < ne for all k > K + 1, (5.21) 

V'[k) 

v ' t=\5 0 k 1 ~ a \+l 

where 5 0 > 0 and K 0 e { L. L + 1,... } are fixed such that (15.161) and (15.171) hold. From (15.201) . 
(15.211) and Lemma 1531 we obtain the following result. 


Lemma 5.4 Suppose that Assumptions 1531 \5.2\ and \5.3\ are satisfied. Let L = MN, where 
N 6 N and Me N are fixed such that ( 15.61) and ( 15. 71) hold. Furthermore, fix 

(i) k > 0 and e e (0,1) such that ( 15.201) holds; 

(ii) <y 0 > 0 and Kq € {L, L + 1,... } such that ( 15. 761) a«<7 ( 15. 7 71) hold; and 

(iii) K e {A'o, K 0 + 1,... } such that ( 15.271) holds. 
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We then have 

OO 

^2Pjf(k-,t)V(£)e~V{k)e<-KV'(k)e, k>K+ 1. (5.22) 

e=o 


Proof. It follows from (15.81) and K > K 0 > L that, for k > K + 1, 

OO 

^2P^(k-J)V(i)e- V(k)e 

OO 

= A*^(£)V(k + £)e-V(k)e 



A*™(£)V(k + £)e + A*™(£)V(k + £)e-V(k)e , (5.23) 

£=L5 0 fc 1 -“J + l t=-L 

where, by convention, any empty sum (which has no terms) is defined as zero. It also follows 
from the mean value theorem that, for any k G Z + and —L < t < <5 0 k x ~ a , there exists some 
£ G (0,1) such that 

V(k + £) = V(k)+£V'(k + ££), keZ + i-L<t<5 0 k l - a . (5.24) 
Substituting (15.241) into the second term in the right hand side of (15.231) yields, for k > K + 1, 


OO 

Y J PN{hl)V(t)e-V(k)e 

e=o 

oo L^ofc 1- “J 

^ V(k + £)A*™(£)e + V'(k + ££)£A*M(£)e 

^L^ofc 1 — “J+l £=-L 

L5 0 fc 1_ “J 

+ V(k) J2 A' N M (t)e-V(k)e 

t=—L 

oo 1 _6 0 k 1 ~ a! \ 

< V(k + £)A* N M (£)e+ V'(k + ££)£A*™(£)e, (5.25) 

L^ofc 1- “J +1 l=-L 

where the inequality holds because Yle=-L ' A*f /! (£)e < e for all k G Z+. Furthermore, since 
V' is nondecreasing, we have 

-l 

J2 V\k + ^)M^ M (£)e < V\k -L)J2 tA*™(£)e 

l=—L t=-L 

L<5ofc 1— “J 

+ V\k + dok 1 - 0 ) ZA*N 4 (£)e, k > K + 1. 

r=o 
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Applying (15.161) and (15.171) to the above inequality, we obtain, for k > K + 1, 

V'(k + Z£)£A*™(£)e 


e=-L 


< V'[k) 

= V\k) 

< V\k) 


-1 L‘5 0 fc 1 -“J 

(l-e)Y J £A* N M {£)e + (l+e) ]T £A* N M (£)e 
h=-l i=o 

L<5 0 fc 1_ “J L5ofc 1_ “J 

(l-£) V M<f(«)e + 2e V lA' N M (l)e 


e=-L 

oo 


e=o 


(1 -E) £ tA ‘fW e + 2cJ2 (A 'TW e 


e=-L 


e=o 


< —2 hiV'(k)e, 


(5.26) 


where we use (15.201) in the last inequality. Finally, substituting (15.211) and (15.261) into (15.251) 
yields (15.221) . □ 


We are now ready to establish the drift condition on P^f and thus P M . We fix 


jM 


v{k ) = V(k)e 1 k G Z+, (5.27) 

<j>(t) = nV'{y- l (t)), t> 1, (5.28) 

where V _1 denotes the inverse function of the increasing and differentiable function V (see 
Assumption l5.3l) . Clearly, v e BM, ; . Furthermore, it follows from (15.281) that 

nV'{k)e = (f) o V(k)e = (f) o v(k), keZ + . (5.29) 

Substituting (15.271) and (15.291) into (15.221) . we have 

OO 

Px (fc; £)v(£) — v(k) < —0 o v(k), k>K + 1. (5.30) 

1=0 

We also have 

OO 

J2 P N^£)v(£)-v{k) < -cj) o v{k) + be, k = 0,1,..., K, (5.31) 

1=0 

where 


b — inf < x > 0; xe > ^ £)v(£) — v(k) + 0 o v(/c), k 


i =o 


Combining (15.301) and (15.311) yields 



Pn v < v — 4> ° v + bl K . 


(5.32) 


( 5 . 33 ) 
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From v G BM d , (15.91) and (15.331) . we obtain 

P M v < v — 0 o v + bl k- (5.34) 

To use Theorem 14.11 it remains to show that the function 0 in (15.281) is qualified for the 
function 0 appearing in Theorem 14.11 which is accomplished by Lemma l531 below. 

Lemma 5.5 The function 0 in ( 15.281) is nondecreasing, differentiable and concave. Further¬ 
more, lirii/^oo 0'(t) = 0. 

Proof of Lemma 1531 Since = 1 /V'{V~ 1 (t)) fort > 1, we obtain 

m = ■ (v-'nt) = vcV-w f > L (535) 

It follows from (15.351) . V'{x) > 0 and V"(x) > 0 for x > 0 that 

<j/(t) > 0 , t > 1 , 

which shows that 0 is nondecreasing. It also follows from (15.351) and condition (iv) of As¬ 
sumption 15.31 that 0' is nonincreasing, which implies that 0 is concave. In addition, since 
lim^oc V'{x) = oo (see condition (iii) of Assumption 15.31) . we have lim x _ i . 00 V(x) — oo and 
thus lim^oo I/ -1 (f) = oo. Therefore, (15.351) together with (15.131) yields lim^^ 0'(t) = 0. □ 

The following theorem is immediate from Theorem 14.11 with P = P and 0 o v(k) = 
nV'{k)e (see (EH ). 


Theorem 5.1 Suppose that all the conditions of Lemma \5,4\ are satisfied. Furthermore, suppose 
that P m (K ; 0)e > 0, and fix B G (0, oo) such that BP M (K ; 0)e > be, where b is given in 
( 15. 521) . Under these conditions, we have 


(n) 7T 


< 


1) 


(V(l) + B) + 


2 mMbd 
nV'fn) 


for all m , n G N, (5.36) 


where the composite function r 0 o c^.b is given by ( 15.51) . ( 14.51) and ( 15.281) . In addition, ifK = 0, 
then 


| (n) ”n 


7T r , - 7T" < 


r>(m - 1) 


V(l) + 


2 mMbd 
nV'(n) 


for all m, n G N. 


(5.37) 


Remark 5.5 Recall that lim^oo V'(x) = oo (see condition (iii) of Assumption l5.3l) and Hindoo V~ 
oo (see the proof of Lemma l5.5l) . Therefore, lim^oo 0(f) = lim^oo nV'(y~ l (t)) = oo, which 
leads to Hindoo r^{x) = oo, as stated in Remark [T2l Consequently, we can choose m, n G N 
such that the error bounds (15.361) and (15.371) are reduced to any desired value less than two. 
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5.2 Special case 


In this subsection, we consider the LC-block-augmented truncation of a special block-monotone 
GI/G/l-type Markov chain, for which we establish an error bound with specified parameters in 
accordance with Theorem 15.1[ To this end, in addition to Assumption l5.1[ we assume that P in 
(15.11) is reduced to 

/ A(0) A(l) A(2) A(3) ••• \ 

A(-l) A(0) A(l) A( 2) 

A(-2) A(—1) A(0) A(l) ••• , (5.38) 

A(—3) A(—2) A(—1) A(0) 


V 




with 


A{k) — 


A{k) — 


k < —1, 


0 2 k ~ 1 
2 k ~ 1 0 

/ (k + 1)~* \ 


0 

(k+ 1) 


-fa 


CGSr) 

0 


k G Z+, 


(5.39) 


(5.40) 




\ C(h) 

where 2 < /3i < f3 2 and ((•) denotes the Riemann zeta function. The matrix P in (15.381) 
can be regarded as the transition probability matrix of an irreducible reflected Markov additive 
process d Chapter XI, Section 2e]. It is easy to see that the stationary probability vector zu of 

A = Er™ A ( k ) is s iven b y 

' i i 
2 2 


zu = 


(5.41) 


For convenience, let 

{ 9 k-l h < _ 1 

i (fe’+ D- g ‘ ,” z ’ 
2 C(ft) ’ + ’ 

It then follows from (15.391) . (15.401) and (15.421) that 

ai(k) 


A(k)e = 


and thus 


where 


a 2 (k) 

OO 

kA(k)e 


2 fc_1 , 

a 2 (k) = { l(k + T)- p2 

2 cm ' 


k e z, 


k < —1, 


k G Z. 


(5.42) 


k=—oo 

OO 

ai := ^ fcai(fc) = - 

k=—oo 
OO 

a 2 := ^ ka 2 {k ) 

k=—oo 


a i 

a 2 


1 A C(/3i-l) 

2 V C(/3i) 

1 ^2-1) 

CGSa) 



(5.43) 

- 3 ). 

(5.44) 

- 3 ). 

(5.45) 
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Substituting (15.411) and (15.431) into (15.21) and using (15.441) and (15.451) yield 


i ( C(A - i) . C(ft-i) „ 

2 + “ 2 - 4 V CXA) + —(Oh) 6 


Note here that 1 < ((s 2 ) < C(si) < 7t 2 /6 for 2 < si < s 2 , which leads to 


C(/?1 - 1) 7T 2 5 

1 < —-- < — < — 

C(fti) 6 3’ 

Therefore, from (15.441) and (15.451) . we have 


C(/?2 — 1) 7T 2 5 

1 < - L < — < 

C(ft) 6 3 


(5.46) 


(5.47) 


ai <0, a 2 < 0. 


Applying these two inequalities to (15.461) . we obtain cr < 0. i.e., Assumption 15.21 holds. As a 
result, P in (15.381) has the unique stationary probability vector tv. 

Recall that Theorem 15.11 holds under all the conditions of Lemma 15.41 Therefore, to fulfill 
the conditions, we determine parameters N £ N, M £ N, k > 0, e £ (0,1), 5 0 > 0, K 0 £ 
{L , L + 1,... } and A £ {ATo, Ao + 1,... }. 

We begin with N £ N and M £ N. In the present special case, the stochastic matrix P\ in 
(15.31) is expressed as 


A( o) 

A( 1) 

M2) 

-4(3) ■ 

" ^ 


A(-l) 

A(0) 

-4.(1) 

-4(2) ■ 



O 

A(-l) 

-4(0) 

4(1) ■ 


(5.48) 

o 

O 

A{- 1) 

-4(0) ■ 

•• ) 



Note here that (15.41) yields 

-l 

Ai(-l) = A(-1) = ^2 A(k), A 1 (k) = A(k), ke Z+. (5.49) 

k=—oo 


Thus, we have 


kAi(k)e 

k =-1 


—A(—l)e + ^ kA(k)e 

k= 1 


( l f Cdi -1) ^ 

2 \ C(A) J 

1 f C(ft - 1) _ \ 

V 2 v c(A) y 


\ 


< 0(5.50) 


/ 


where the second equality follows from (15.391) and (15.401) . and where the last inequality follows 
from (15.471) . Furthermore, applying (15.411) and (15.501) to (15.51) with N = 1, we obtain 
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The inequalities (15.501) and (15.511) imply that (15.61) and (15.71) hold for N = M 0 = 1. To proceed, 
we fix N = M = M 0 = 1 and thus L = MN = 1. 

We then consider k > 0 and £ G (0,1). Using (15.491) . we can reduce (15.201) to 


-(1 — e)A(—l)e + (! + £■) ^fA(£)e < —2ne. 


i= l 


Substituting (15.391) and (15.401) into the above inequality, we have 


/ i + £ C(& - i) _ , \ 

2 C(A) 

1 + £ C ($2 — 1 ) _ i 


< -2k 


V 2 C(/? 2 ) " 

Since the Riemann zeta function ((s) is log-convex for s > 1 (see, e.g., 0), 

d/C0-l)\ C(s-l) fC'(s-l) C'(s)' 


ds V C(s) 


C(s) VC(s-l) C(s) 

£ %jr{s logC(s - 1 ) -a; logC(s) U 0 ’ 


which leads to 


C(ft - 1) C(ft - 1) 
C(ft) - C(/5i) ' 

The inequalities (15.521) and (15.531) imply that (15.521) holds if 

i + £ C(ft ~ i) 

2 C(ft) 

Therefore, we fix k > 0 and e G (0,1) such that 


1 = -2k. 


r _U 1 C(ft-i) \ i 
2C(ft) ) 24' 


£ = 


2C(ft 


-1 e 


1 1 
To’ 2 


(5.52) 


(5.53) 


(5.54) 


(5.55) 

(5.56) 


2 VC(ft -1) 

which satisfy (15.541) and thus (15.521) . 

Next, we determine <5 0 > 0, K () G { L. L + 1,... } (with L = 1) and the function V in 
Assumption 15.31 From (15.401) . we have 

1 


A(k) 

hm — T - 

k—too K P 1 


° 2((ft) 

0 0 


which corresponds to the case discussed in Appendix IA.21 Thus, we fix a = 0, ft G (1, ft — 1) 
arbitrarily and 


V{x) — (x + 


x > 0, 


(5.57) 
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with x 0 > 0. It then follows that Assumption 15.31 holds for a = 0 (see Appendix lA.21 ). It also 
follows from (15.571) . a = 0 and L — 1 that (15.161) and (15.171) are reduced to 


Note that 


sup 

k> 0 


k + x 0 
k + x o — l 
k + x 0 

(<5q + 1 )k + x 0 


— 5o + 


k + x 0 

Thus, we fix K 0 G N, <5 0 > 0 and x 0 > 0 such that 


\l/09o-l) 

k 2 A 0 + 1, 

(5.58) 

■)l/03 o-l) > 

k > K 0 + 1. 

(5.59) 

inf 

fc>0 

k + x o-l 1 


k + x 0 " x 0 ' 



A' 0 = l, S 0 = (l + e) 1 ^°- 1 )-l, 

1 

X ° ~ i_(i_ e )i/(A)-i)’ 

where e is given in (15.561) . It is easy to see that (15.581) and (15.591) hold. 

Finally, we discuss the remaining parameter K G { K {] , K 0 + 1,... } (with K 0 
denote 

p = max(l + 1/5q,x q ). 

Let Ci and 67 2 denote 


(5.60) 


1). Let p 
(5.61) 


Ci = 


—/3i+/?o+l 
0 


2/?o (/?i ~~ A) — l)C(Pi 


C,= 


—fe+Po+l 

0 


2/?0 (Ai — A) ~~ 1)C(A0 ’ 


(5.62) 


respectively. Furthermore, fix 


K = max 


Ci 

K 


1/091-2) 



1/092 - 2)' 


It then holds that 

OO 

—-— V(k + £)A(£)e < ne for all k > K + 1, 

V'(k) 

' r=[(SofcJ+i 


(5.63) 


(5.64) 


which is proved in Appendix |B] Inequality (15.641) together with (15.491) implies that (15.211) holds 
for M — N — 1, a — 0 and K given in (15.631) . 

We have confirmed that all the conditions of Lemma 15.41 hold for N = M = 1. Therefore, 
Lemma [5Al implies that 


J2 p i(k-J)V(e)e- V{k)e < -nV\k)e, k>K + 1. (5.65) 

i=0 

We now fix d G Blrf such that 


v(k) = V (k)e = (k + x 0 Y°e, 


k G 7L. 


(5.66) 
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where x 0 is given in (15.601) . We also fix </> as in (15.281) . Thus, (15.291) holds. Applying (15.291) and 
(15.661) to (15.651) yields 

OO 

Y^ Pi(k; f)v(£) — v(k) < — </> o v(k), k>K + 1. (5.67) 

e=o 

Consequently, we can establish the drift conditions (15.331) and (15.341) with N — M — 1 once 
we find an upper bound be for P\ {k\ £)V(£)e — V(k)e + KV'(k)e ; k = 0,1,..., K}. 

We specify the parameter b. It follows from (15.391) . (15.401) and (15.481) that 

OO 

Y p i(°; $)V(l)e - V (0)e + KV'{G)e 
1=0 

oo 

= A(0)C(0)e + Y A(£)V(£)e ~ ^(0)e + «^'(0)e 

£=1 

oo 

< Y A (£)V(£)e + kV'( 0)e, (5.68) 

i=i 

where the inequality is due to A(0)e < e. Similarly, for k = 1,2,..., K, 

OO 

Y p i( k 'i £)V(£)e ~ V( k ) e + KV\k)e 
e=o 

oo 

= A{-l)V(k - l)e + ^ A(£)V(k + i)e - V(k)e + kV\ k)e 

e=o 


< Y A (t)V(k + t)e + KV'(k)e, (5.69) 

e=o 

where the inequality holds because A(— l)e < e and V(k — 1) < V{k) for all k e N. Since V 
and V' is nondecreasing, we have, from (15.681) and (15.691) . 


OO 

Y p i( k '> £)V(£)e ~ v ( k ) e + KV\k)e 
£=0 

oo 

< Y a (£)V(K + £)e + k\ y'(K)e, k = 0,1,..., K. 

e=o 

Applying (15.401) and (15.571) to the right hand side of the above inequality, we obtain 


where 


Y p i( k ^)V(£) e ~V( k ) e + KV'(k)e <be, k = 0,1,...,AT, 
£=0 


f i ™(K + e + x of° i ^(K + e + x 0 )a\ 
maX \2C(A) “ (* + !)* ’2C(A.)^ (^ + 1 ) /32 ) 

+ k/3q {k + Xq)^ 0 1 - 


(5.70) 


(5.71) 
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Substituting (15.291) and (15.661) into (15.701) results in 

OO 

P\ (k\ £)v(£) — v(k ) + 0 o v(k ) < be, k = 0,1,..., K. (5.72) 

£=0 

Combining (15.721) with (15.671) leads to 

P\ v < v — 0 o v + blx- (5.73) 

Recall here that P -<d Pi £ BM,/ and v G Bl^. Thus, Pv < P\V (due to (15.91) with N = M = 
1). This inequality and (15.731) yield the drift condition on P: 

Pv < V — 0 O v + blx- 

In addition, P{k ; 0)e = A(—k)e > 0 for all k G N, which follows from (15.381) . (15.391) and 

(ism 

We have shown that all the conditions of Theorem 15.11 are satisfied. We now fix 

B = 2 K b, (5.74) 

where b is given in (15.711) . It then follows from (15.381) . (15.391) and (15.401) that 

BP(K■ 0)e = 2 K bA(-K)e = be. 

As a result, using Theorem 15.11 we can derive an error bound for the special case considered 
here. 

In what follows, we present the components of the error bound. Since V~ l (t) = 1 1 / /3 ° — x 0 
for t > Xq°, the function 0 in (15.281) is expressed as 

0(f) = K0 O f 1_1/A \ t > 1. (5.75) 

Therefore, the function H$ in (13.41) is given by 

r x v - i+i/A> 

H^(x) = / ---d y = k~ 1 {x 1, ^° - 1), x > 1. (5.76) 

J i K Po 

Substituting (15.751) and (15.761) into (13.51) . we have 

r^ix) = k/3 0 (kx + l)^ 0-1 , x > 0. (5.77) 

Furthermore, applying (15.741) and (15.751) to (14.51) . we obtain 

C(/),b(x) = cx, x > 0, (5.78) 


where 


c = (2 A '6 + l )- 1+1//?0 


( 5 . 79 ) 
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Combining (15.771) and (15.781) yields 

o C 0 .b{x) = kPo(kcx + l)^ 0-1 , x > 0. (5.80) 


Consequently, letting M — 1 and d — 2 in (15.361) and using (15.571) . (15.741) . (15.781) and (15.801) . we 
obtain 


(n) XT n XT 


< 


8c _1 

n/3 0 {u.c(m — 1) + 1}^ 
4 mb 

K/3 0 (n + x 0 ) /?0_1 


;rT {(l+ a:o )' 3 » + 2 A 6} 
for all m, n G N, 


(5.81) 


where /c, x 0 , K, b and c are given by (15.551) . (15.601) . (15.631) . (15.711) and (15.791) . respectively. 

Finally, using the obtained bound (15.811) . we determine a truncation parameter n £ N such 
that 11 ( n ) 7r n — 7r11 is within a given tolerance E G (0, 2), i.e., 


(n) IT-n 7T 11 — E. 


(5.82) 


Let m 0 and n 0 denote 


8c -1 £ 

m “ = llml < m 6 N; KMK c(,n - 1) + l}^- 1 {(1 + X ° f ° + 2Kf ’ } - I 


no = min < n G N; 


Arrtnb 


< 


£ 


Kf3o(n + xq)P°- 1 2 j ’ 


respectively. We then have 


m 0 = 


1 

nc 


16c 


k/3o £ 


-l 

— {{l+xof 0 + 2 K b) 


l/(/9o-l) 


+ 1) 


no = max 1, 


/ 8 m 0 6\ 


i/(4o-i) 


- x 0 


(5.83) 

(5.84) 


Substituting m 0 in (15.831) and n Q in (15.841) into (15.811) yields (15.821) . 


6 Concluding remarks 

This paper studied the estimation of the total variation distance between the stationary prob¬ 
ability vectors of a discrete-time block-structured Markov chain and its LC-block-augmented 
truncation. The main contribution of this paper is to present a total-variation-distance error 
bound for the stationary probability vector of the LC-block-augmented truncation under the as¬ 
sumption that the original Markov chain is block monotone and satisfies the subgeometric drift 
condition proposed in [J3J. This paper is complementary to the author’s previous study [fl8l , 
which considered discrete-time block-monotone Markov chains satisfying the geometric drift 
condition. The author lf20i also considered continuous-time block-monotone Markov chains 
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with exponential ergodicity and derived a total-variation-distance error bound for the stationary 
probability vector of the LC-block-augmented truncation. The present study and the author’s 
previous ones [18; 20] depend on the notion of block monotonicity. 

Recently, without block monotonicity (including monotonicity), the author lf2TTl established 
computable upper bounds for the absolute difference between the time-averaged functionals of a 
continuous-time block-structured Markov chain and its LC-block-augmented truncation under 
the assumption that the original Markov chain satisfies the /-modulated drift condition (see 
lf2Tl Condition 1,1]). The /-modulated drift condition includes the geometric (or exponential in 
continuous time) drift condition and the subgeometric (or subexponential in continuous time) 
drift condition proposed in (31 as special cases. Therefore, the error bounds in (2TI are widely 
applicable, though they are more computationally costly than those in this paper and [18, [20] 
with block monotonicity. 

A Examples of function V in Assumption 15.31 

We begin with the following lemma. 

Lemma A.l Equation ( 15. / ()\j holds if there exists some a £ [0,1) such that at least one of ( IA.il) 
and ( IA.2D below is true for any 8 > 0. 



(A.l) 


OO 




< oo and 


(A.2) 


where V : [0, oo) —* [1, oo) is an increasing, convex and log-concave function that satisfies 
conditions (i)-(v) of Assumption 15.31 

Proof Since V is log-concave and log V (0) > 0, we have, for x, y > 0, 


log V ( x ) + log V(y) > 



> log V(x + y), 


and thus V{x + y) < V(x)V(y) for x, y > 0. Using this inequality, we have 


OO 


V V(k + £)A* N M (f)e < V(k) Y, V(£)A*™{£)e. 


1 = L5fc!-“J+1 


£=L<5fc 1 -“J+l 


Therefore, (IA.1I) implies (15.101) . 
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Next, we prove that (IA.2I) implies (15.101) . To this end, we suppose that ( IA. 21 ) holds. It then 
follows that, for any c > 0 , YlrLo VA*^ 1 (£)e is finite and thus 

OO 

lim J2 V(ci 1 ^ 1 ~ a) )A*f(£)e = 0. (A.3) 

i=[8k 1 - a \ + l 

In addition, since V is increasing and convex, 

lim inf V'(k) > 0, (A.4) 

k—too 

and, for any <5 > 0 , 

OO OO 

V(k + £)A*™(£)e< V{£+{£/5) 1/{ ~ l -°^)A*^{f)e 

1= [5fc 1—a J+l 1=16^-° \+l 

oo 

< V(c s £ 1/{1 - a) )A*^{£)e keZ +1 (A.5) 

e=[8k 1 - a \ + l 

where eg > 1 + Combining (IA.3I) . (IA.4I) and (IA.5I) . we have (15.101) . □ 

Using Lemma lATl we present the typical examples of the function V satisfying Assump¬ 
tion [531 by considering the three cases: 

(a) A(k) x g\(k) exp {—ck a } for some c > 0 and 0 < a < 1 ; 

(b) A(k) x g 2 (k) := k~& for some (3 > 2 ; and 

(c) A(k) x gz{k) := k~ 2 {log(k + l)} -7 for some 7 > 1, 

where we write H(x) x g(x) if H is a nonnegative matrix-valued function such that both 
lim inf ^oo H(x)/g(x) and lim sup x _ >00 H(x)/g(x) are finite and not equal to the zero matrix 
for a scalar-valued function g that is eventually nonnegative. For i = 1, 2, 3, it follows from 
A(k) x gi(k ) and (15.41) that A N {k ) x gt(k). Thus, A*™(k) x g^k) for i = 1,2,3, which 
can be readily proved by using the extensions of [9] Proposition A.2. 6 ] to the upper and lower 
limits. 

We will see later, from the examples of the function V, that the decay of the error bound 
(15.361) is moderately exponential (i.e., heavy-tailed Weibull-like) in Case (a); polynomial in 
Case (b); and logarithmic in Case (c), as the truncation parameter n increases. Therefore, Cases 
(a), (b) and (c) are called moderately exponential case , polynomial case, and logarithmic case, 
respectively. 

A.l Moderately exponential case 

We suppose that A(k) x g\(k), i.e., A(k) x exp{— ck a } for some c > 0 and 0 < a < 1. We 
then fix V such that 


V (x) = exp{c 0 (a: + x 0 )“}, 


x > 0 , 


(A.6) 
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where 0 < c 0 < c and x 0 > 1/ (ocq) l//f> . Clearly, V is increasing and log-concave, and 
conditions (i) and (ii) of Assumption 15.31 are satisfied. In what follows, we confirm that the 
remaining conditions of Assumption ^ .31 are satisfied. 

From (IA. 6 I) . we have 


V'(x) = ac 0 (x + x 0 ) a 1 exp{c 0 (x + x 0 ) a j > 0, x > 0, (A.7) 

V"(x) = aco(x + xo)“~ 2 exp{co(x + xo) a }{aco(x + xo) a — (1 — a)}, x > 0(A.8) 


which yield 


V'{x) 

V(x) 

V"{x) 

V'(x) 


= ac 0 (x + x 0 ) 


a—1 


x > 0 , 


= (x + xq) {ac 0 (x + x 0 ) a — (1 — a)}, x > 0 . 


Equation (IA.7I) implies that condition (iii) of Assumption [53] holds and that 


, , V'(x + Sx 1 “) 

lim lim - - 

54,0 x^-oo v'yx) 


.. ( Sx 

lim hm 1 4- 

54.0 i-K» y x + x 0 

x exp < c 0 (a: + x 0 )“ 


1-0 \ “- 1 


1 + 


Ac 


1 —a 


X + Xq 

f cxSx^~ a 

= lim lim exp < c 0 (x + x 0 )“- 

< 54.0 x->oo 1 X + Xq 


- 1 


X 


= lim lim exp < acoS 

54,0 x-)-oo 1 yx + xo 

= lim exp {acoS} = 1 , 

<54,0 


1 —a 


(A.9) 
(A. 10) 


which shows that condition (v) of Assumption l5.3l holds. In addition, since x 0 > 1 /(ac 0 ) 1/a > 
{(1— a) / (acn)} 1 / 01 . it follows from (IA. 8 I) and (IA.10I) that, for x > 0, V"(x) > 0 and V"(x)/V'(x) 
is nonincreasing, i.e., condition (iv) of As sumption [53] is satisfied. 

Finally, we confirm that (15.f0l) holds. It follows from (IA. 6 I) . (IA.9I) and A (k) x exp{— ck a } 
that there exists some finite C > 0 such that, for all sufficiently large k. 


YM 

V'{k) 


00 00 

V(t)A*M(£)e < C(k + x o y- a exp{ —(c 

£=L<5fc 1 —“J+l 1 = L5fc 1_a J+l 


c 0 )f"}e, 


which implies that 


lim 

fc —100 V [kj 


£=L < 5A: 1 —“ J+l 


0 . 


Combining this and Lemma lATTl we have (15.101) . Consequently, the function V given in ( I A. 61 ) 
satisfies all the conditions of Assumption l5.31 
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A.2 Polynomial case 

We suppose that A(k) x c/ 2 (&) = k~P for some (3 > 2, and fix V such that 

V(x) = (x + x > 0, (A.11) 

where 1 < (3 0 < /3 — 1 and x 0 > 0. From (IA. Ill) , we have 

V\x) = (3 0 (x + xo )^ 0-1 >0, x > 0, (A.12) 

V"(x) = /3 0 ((3o — l){x + xoY°~ 2 >0, x > 0. 


Clearly, V is increasing, convex and log-concave, and conditions (i)-(iv) of Assumption [5A]arc 
satisfied. From (IA.12I) . we also obtain 


lim lim 

<54-0 x —^oo 


V'{x + Sx) 
V'(x) 


limfl + t))*- 1 = 1, 
54-0 


and thus condition (v) of Assumption l5.3l holds for a = 0. Furthermore, it follows from (IA. lib . 
a = 0 and A(k) x k~P that 


lim = S^° for any S > 0 , 

k—>oo V ( k ) 

V(k 1/{1 ~ a) )A**\k) x kP°~ p . 


These equations, together with (3 0 — (3 < —1, imply (IA.2I) . Therefore, Lemma lATl shows that 
(15.101) holds for a = 0. We have confirmed that the function V given in (IA. lib satisfies all the 
conditions of Assumption l5.3l 


A.3 Logarithmic case 

We suppose that A{k) x g 3 (k) = k~ 2 {log(k + l )} -7 for some 7 > 1, and fix V such that 

V{x) = (x + x 0 ){log(a: + a: 0 )} 7 °, x > 0, (A.13) 

where 0 < 70 < 7 — 1 and x 0 > e 2 . From (IA.13I) . we have 

V'(x) = {log(a; + x 0 )} 70_1 [log(a; + x 0 ) + 70 ] > 0, x > 0, (A.14) 

V"{x) = 70 ( 0 ; + xo) _ 1 {log(a; + x 0 )} 70 ~ 2 [log(x + x 0 ) + 70 - 1] > 0, x > ($A.15) 


Therefore, V is increasing, convex and log-concave and, conditions (i)-(iii) of Assumption l5.3l 
are satisfied. 

In addition, (IA. 141) and (IA.15I) yield 


V"(x) 

V'{x) 


7o(x + x 0 ) 1 


{log(a: + £ 0 )} 1 


log(s + Xq) + 7o - 1 

log(x + x 0 ) + 70 


x > 0. (A.16) 
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We now set y = log(x + xq ) > 2 and denote by F(y ) the part in the square bracket in the right 
hand side of (IA. 161) . i.e., 


f(v) 


y + 7o -1 
y(y + 7o) ’ 


y> 2. 


We then have 


\ (l/ + 70 — l) 2 + 7 o — 1 f .. 

F(V) = - tofa + 7o)P <0 

Consequently, V"(x)/V'(x) is nonincreasing for all x > 0, i.e., condition (iv) of Assump¬ 
tion [53] holds. 

It remains to show that (15.101) and condition (v) of Assumption 15.31 hold. It follows from 
(IA. 141) that 


V'(x + 5x) 

Inn ————— = 1 for any o > 0, 

x^-oo V [x) 


which shows that condition (v) of As sumption [53] holds for a = 0. It also follows from (IA.13I) . 

a = 0 and A* I ^ r (k) x k~ 2 {\og{k + l)} -7 that 


r V ^ 8k ) x x n 

lim ——— = o for any o > 0, 

fc—K5o V ( k) 

V{k l/ F~^ A *M^ x fc -l{ log ( fc + l)}10-7_ 


Combining these equations with 70 — 7 < —1, we have (IA.2I) . Therefore, (15.101) holds for 
a = 0 (see Lemma DOT) . As a result, the function V given in (IA.13I) satisfies all the conditions 
of Assumption l5.3l 


B Proof of (E3> 

We first note that (IA.5I) holds for any a G [0,1) and S > 0. We then fix M = N = 1, a = 0, 
S = S 0 and cs 0 = p > 1 + l/<5 0 , where p is given in (15.611) . It then follows from (IA.5I) . (15.401) . 
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(15.491) and (15.571) that 
1 


OO 

V(k + £)A{£)e 


i=[So fcj+l 


< 


V'{k) 


OO 

E V(pt)A(l)e 


t— s () k\ + 1 


A 


< 


P _ 

2f3 0 (k + xo)^- 1 

( 


( ^ (l + x 0 /p)A>(l+l )-(h \ 

Cifti) 

t=[&o fcj+l sv '’ 

(£ + xo/py°(f + l)-^ 


< 


p 


A 


2/5 0 fcA)-i 


V £=L<5 0 fcJ+l 

^ (£+ 1 )-^+* \ 




(,= \Sok\+l 


E 


C(A) 

(£ + 1)-/3 2 +/3o 


, fceN, 


(B.l) 


\ ^=L<5 0 fcJ+i / 

where the last inequality follows from xq > 0 and xo/p < 1 (due to (15.611) 1. Note here that 

E (t+i)-f< r (x + i)-e<ix < f j>1 . 

fc £y+i -W P - 1 

Applying this inequality to t IR-ll i yields, for k € N, 


V'(k) 


OO 

^ y(Jfe + f)A(£)e < 


P 


A 


^=[t5ofcJ + l 


2/? 0 ^' 1 


/ (5 0 fc) _/3l+/3o+1 \ 

(A-Aj-i)C(A) 

(AA _/32+/3o+1 f 

v o - i)c(/? 2 ) y 


p4o 

2 A 


/ on A - 4i+2 

/ r-/3i+/3 0 + l K 

°0 




V 


r—^2+/So+l 
°0 


Cifc-^+ 2 \ 
C 2 k-P*+ 2 ) ’ 


(A - A - i)C(A) 

fe— /^ 2+2 

(A - A, - i)C(/? 2 ) / 


(B.2) 


where the last equality follows from (15.621) . Finally, (IB.2I) and (15.631) imply that (15.641) holds 

all k > K + 1. 


for 
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